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Abstract 

The goal of this brief pedagogical article is to show that Binary Decision Diagrams 
are a special kind of Bayesian Net. This observation is obvious to workers in these 
two fields, but it might not be too obvious to others. 
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The goal of this brief pedagogical article is to show that Binary Decision 
Diagrams ||TJ are a special kind of Bayesian Net0. This observation is obvious to 
workers in these two fields, but it might not be too obvious to others. 

Let Bool = {0, 1} where = false and 1 = true. For any integer n, functions 
/ : Bool n — > Bool are called Boolean expressions. Suppose x, y G Bool. As is 
conventional, we will use xV y (resp., x Ay) to denote the Boolean function of x and 
y that evaluates to true if and only if x OR y (resp., x AND y) is true, x will denote 
the opposite of x. 

Random variables will be indicated by underlining. P(a = a) will denote 
the probability that the random variable a assumes the value a. We will abbreviate 
P(a = a) by P(a) if this doesn't lead to confusion. 

Let Sy denote the Kronecker delta function; it equals 1 if x — y, and it equals 
if x 7^ y. 

The if -then-else function a(h, c , Ci) is defined by: 



a{h, c , ci) = [h=> (co, ci)] = [(h A c ) V (7i A c x )\ = | c ° if /j = x ■ i 1 ) 

One can interpret h as the hypothesis, cq, c% as the two possible conclusions, and a as 
the assertion, which may or may not be true, that if h, then ci, else Cq. 
Note that for any function / : Bool — > Bool, one has 

/(s) = [z=>(/(0),/(l))]. (2) 

This formula is known as the Shannon expansion formula of f with respect to x. Given 
any Boolean expression /(xi,x 2 , ■ ■ ■ ,x n ) in n variables, one can Shannon expand / 
with respect to x\. This yields an if-then-else expression whose two conclusions 
depend only on the n — 1 variables X2,x^, ■ ■ .x n . Next, one can Shannon expand 
these 2 conclusions with respect to x 2 , yielding 4 conclusion that depend only on 
n — 2 variables. And so on, until all final conclusions depend on zero variables, so 
they are either or 1. The conclusions from all stages of this process can be arranged 
as a decision tree. For instance, consider the following Boolean expression: 

f{x 1 ,x 2 ,x 3 ) = [(xx Vx 2 ) Aij)] . (3) 

Since 



[(xi V x 2 ) A x 3 ] = [xi (x 2 A x 3 ,x 3 )] , (4) 
x 2 A x 3 = [x 2 (0,x 3 )] , (5) 
x 3 = [x 3 => (0, 1)] , (6) 

we get the decision tree of Fig.|I[ Some nodes will occur more than once. By merging 
each set of equivalent nodes into a single node, we can transform the decision tree 
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into a directed acyclic graph (dag). These dags, arising from a recursive application 
of the Shannon expansion formula, were invented by R. Bryant in Ref. [||]. He called 
them BDDs (or, more precisely, reduced ordered BDDs). 




Figure 1: A decision tree for (xi V x 2 ) A x 3 . 
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Figure 2: A BDD for (x\ V x 2 ) A x 3 . 



In the field of Bayesian nets, one can define an if-then-else node. See Fig.[| 
The node is labelled by a random variable a(h) which depends on a Boolean parameter 
h. The node has two possible states, and 1. The transition probability associated 
with node a{h) is given by 



P{a(h) = a\co, ci} = <^ (c(hCl) , (7) 

for all h, a, Co, c\ G Bool. This transition probability can be expressed in table form 
as follows. For h — 0, one has 



(co,ci) 



P{a(0) = a\c ,d} 



a 
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(8) 
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Figure 3: If-then-else node. 
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a,(x 3 ) 



Figure 4: A Bayesian net for (xi V^) A X3. 



and for h 



(cq,Ci) 



P{a(l) = a\c ,ci} 
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(9) 



Note that these probabilities are all deterministic, meaning that they are all either 
or 1, none is a fraction. 

The BDD of Fig.|2| is equivalent to the Bayesian Net of Fig.|j. Note that these 
two dags are identical. In the Bayesian net of Fig.|], all nodes are if-then-else nodes 
except for the square ones. Square nodes have two states, and 1. Node (resp., 
node 1) is in state (resp., state 1) with probability 1, and in the opposite state with 
probability 0. 

It is now clear that BDDs are just a special kind of Bayesian Net. 
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BDD 


Bayesian Net 


number of states 


2 


arbitrary 


of a node 






number of arrows 


2 if round node, 


arbitrary 


entering a node 


if square node 




transition probabilities 


deterministic 


arbitrary 


for a node 






number of nodes 


1 


arbitrary 


at top of graph 






number of nodes 


2 


arbitrary 


at bottom of graph 
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